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[if 2 1 ^^-r-^t jl^Jl^iSLSr^Kii^^^©) U 
^ffl^i-S r i: J: o TJR^5£5W6>Sr:^# ur ^^-f- 

^CG (=2^^tf^-^i5^^r7^ ili«^>(t;UT^^ 10 

^ \zM^ $ ^ ^ ^m(DMm^ ^ C G M^^b L 
[ff^:®4l fpTJIj. mm^. «L 

Ac 

^U^^^CGmmtir^OGY^^nt^ CG 

M^-f t ^ titi — ^^^m^-r ^oG^f—^ ;^ ^ 40 

15^7^— tJ'-t— ;^g5j^<^>jRtJ£^5tt;5CGT'— 15'-< 
-;^^f^ocGiij^f^#^>i^;^::$'^5&Mfct3-^l^^l$ 
i:. CGx— 15^-<— ;^^$f^^c|E^$;^^TV^scG^l^^^;l 
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't^xo\^mmvfzcGmiSLtm'-'mM. m~mn(Dc 

o\^M^xmm^h^\^^\'xm^KX^^mxm7^i.. c 
Gm^i^xm7r^^rifzM^m^Wim:im^m^-r<>zt 
x\ ^(oM^!^(Dm^'^y^—i$' ^mmifzm^L., fe>5v^ 

m.^.^^t^x ^ \,-mm\^xm< x o\^cGmm^Bmu 
.^.xm^i.. h^\^^n^u^i^^<oM^^(D&im^cG 

m^^m&x^^^Mxm^i^. cGmi^^<oMM^^ 

y'-'if $r®Mf:i^^-rs Xo\z. X^Xtb^mim. 1 7bm 1 
^ U T $ i^ -5 0 $> ^ V ^ ^ C G ^ M 

^m^^^^'^vx^f\.h<r:>m¥^m^^^M^^^m 
^(o^mm^hm-(nmmxmM^\^fz.mk^—d^-< 



(3) 



2003-287434 



(ot"- ^ ^ ^ 5 V ^ c G m^i)^ h ^»:5tm 

:S 1 7 f:if5^<^iii^1t^^t^v-:^7^i>.o io 

^ ^ J: 9 1 75^ 2 0 ^OV^i*tVi6^::|B«^?^® - 

G-r-^-<-;^$5. fiM^i^-^I^MIfe^ ^^ifeMi^T^- 
0 5f5^«8 7!FM2 1 ^?:)V^-fi^^^c|a«(Z>^i^«^tfft:g|^V 30 

fS*^ 1 T^M 2 3 OV>-rtt3&^;ii5«0®«if ^«|^>-;:<. 
[000 1] 



[0002] 

^t^mi^-^fi. ^^:^TJ^\z.x.ox\^mmm^^7f^x^^ 

[0 0 0 3] SSS • Wm^mmrT^^m - WW 

3 0 9 9 1 0 3#{::J:^iI^ • ^^)m<Dm.U^^f:^^m 

mwti>mm^tix\^^^o :z<Di^mmmx\'t^ mm\^i&m 
m^i^n-r^ r t xm^mm x^xm^titimmcomm^ 

^h(ot LT^^-r 5 c t xwi^iizi^mx^ ^ 

[0 0 0 4] 

fiib^ h (om^mxyxmmf^tLm^mi:^^^^^ :Ltt^ 

0^^^h(ox^^o 

10 0 0 51 ^fz^u^y'::^^mmmxw)m^m^i^m 
:}sn^^i^mn(D^mnmmx^^. i.^^hm^(r>M^ 

[0 0 0 6] ^:zx^^mn^±(DJ:o^£^^^l.tim 

^m\^m:^tm^titih<Dx\ ' mm^<Di^(D^m 

\zi3n<>&:&mntmmHn. ^i^TLit-r^cox^^. 

cmmtL^xnm^i.. ^i^f^\^^^^^^mM^^ 
(07'-i^^-:^^mm'r^:itx\ ^mM^^mm±\^ 

^^^nCG±^ ^ tifz^l^Tzmn^ (DM^!^ fj: tt -5 ;t 
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[0 0 0 7] 

^ ^^m^^mhx^m^ hm^-r s r j: o x^w^ 
mm.\^(oi^mt^ l^»$-^Ti3v^ 

5o ^fcii^fi. ii^. ^pjjik m^. t^Lii. ^ 

f^^^4, 5<t. CGMIfe>fb^ttfc7^-:^^f^#|B^-r 

iKiF£5^^:SLr;^c G-r"— c5'-<~;^a5 7 rto c GW^m^^ 

t^^x.X^^^ ^;^^1115«. V^tR^k^m^ms 
1. mmi$3 2^ CGB^fe«c3 3^{E:M^;^U. ^^SiL?J^ 
^fe^^^i-SiKSi!.8i^il^^:^*S3 1 F*3tCi5»ta^:^ffiWfe 
^> CGSi4ft^|g^-r6CGMife«c3 3p*9t::i3lt-5CG 



xr)mmxm^v. cGm^^xm7r^^tiftM^!»}t:m 

m<DW}^{:i. m.^^'^ijxo^^mmL.xwxxoii^cG 

^-t-ri-CGMftSrWi^T-S^ffi^T-^^U CGBfi^ 

[^(DM^^^m.m^^m^t^^^m^-ir^:^tx% ^(dm 

-c^-So ^K^5£g^Hfertfc'5v^^iCGl^«^rt<^5^^*^^i^i- 

^^tx. ' mm ' w-n^%Ym\^. ^fih^mm\^ 
m7f^ir^Xo\^ir^^tti^x^^, Jt^iae^^CGM^ 

^^V^^iCG®>fe^t^t^9^^<^[^il{C&V^, M^^^sij 

$ tt ^ ^ 0 -5 V ^ JiiSL^i^S ^ C G i: M'^T *> -5 V ^ 

«mi:iT^^-r 5 r ^ :ei5T-^ So ^i^^^^rs i o f^^^ 

«l^^^^*i^-r5i^T*fet). :f^^iJ)^^:^«3 
1. i*fe®«3 2. CGlif*6«3 3iO^J>?^<C< <tt>V>-rtV}6^ 

S(^r*fe'9. m\z.w^\.tL^m^^^^m^^t\.x. 

Si5 3P^(D«^ejHfe. feSV>«CG7^— ^J'-^— ;^SfP7P^O 

S V > C G ;^ ffi 7 O C G III « ^ It U 

^Si/>CG®^;6^e>H^fe7nM^^I5t^§U> 

^> ^^^^mbm\:^m&K\.xmmt(om^^^'<L 
50 JK^ae^F^to^ite?^, ^(omi^y^-^ t^m^ 



(5) 
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iiff ^s]i6gfe5l/^^iWe b (Wo rid wide we 
b) ^^UT«IS^:^-C#-5J:5t-U. ^ftf^y'-'^' 
>^$P3. CGf^^?fB4. 5. CGv^^— i5^-<— 

8 . ^mts&u 1 0 . *^^fi 1 5 < t 

m^ilmlHI^^5v^^iwe b$:^urg!/^^^$tLrv> 

[0 0 0 8] -l^-hfOct p(;i«^£$ti.fc*^^tc:^-5iii« 

^v^T^D^^_bco:t^^^i:, ^ tt^C Giij>fejt:UfcC 
Glj«<^cD^ii. • CGili^f^#l^(?:>#@(0^ 20 

fci^fe^>. MmW^^^\^X\^^^^j^y^-^^—>^^3 

F^. CG'7^-^5^-<-;^gP7I^^^CfEi^^^#$i^TV^5e5^ 30 

-^^o i^m.^m:^m3 i\zx-^xmm^ti^^um 

CGIlj^«3 3iCj:oT^^$iX'5CGM^P^t-i3 

(oM^!^<r>mi^7'—'$'m%:mmi^x. m^^titznMHi^ 

mm • i^m(onm\^. m^mmmm\^isn^'sm<Drz,ib 
(oiiMo:>m^^u<Dmmm^mm±x^i^^m^'^. m 40 

e>-^5o ^^-i^-<—:^n3\^\^mm^^^tix\^^^ 
i^iE\t^ ^u^. cGif^rttr^-rs^aco^poip 



— ;^a53. CGf^^§P4, 5. CGx — i?'-^— ^^5 7, 

mm^n 1 0 . mTT^mm 1 5 <o<p^/s: < ^ fc-SFP^m^ii 
^tIHI^^5v^^iwe h^^i.xmmm^'r^:itx^m 

sca^pti^jc^-^So vtumm^\zm^xm^^fh^m 

[00 0 9] 

wt\-fhfix\^^m^(Dmm(oi^w^±^. T^oxim^ 
tmm\^x.oxmemM'r^ c t x^m^-^x^ttmrn^ 

5v>|i^^UfeCG@i«"Cfcl9. 
[0 0 10] @fr;^$^x5i^-^l T/i-^-r A^i^Si 

[0 0 11] SMftT^— ^SfP3T-fi. 

M.(o^^^<D^^m^m(D^m(r)m^\^mL^n-^x^ 
:Lfihtmw^m^m&Hnhttx\^^^. ^i^x^ 
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[0 0 121 ^7'-^^—^M3\Z^n^:l^f^ 
?J«efefi^J^F^3 DCG (31^y€^>^}i'^ — :^^^y ^ y 
^ : -E^^TC CG three dimensional 
computer graphics) fcSV'^fi 

G^ftf^^$l54. *>si/^tti»)Mf::cG>fb-t-'5CGgi& 
f^^$B5:^ss»1•6tb-cv^;5o ciHP.(7:>CGf^^SS|54, 5 

(a) XtA^^(D^m 

(b) St*ieii^^cO^SiJ 

to^iF^Sa-^ii^tjco 20 

• m±m^t UT : iii^siife. at^^^. imwtm. x ' 

• m^±^^t UT : ^^s. w^. m^. i^m. uj. 

^<om3i^^ mm 

(d) msy^^<Dms,^^ Y/^. tnm^^^ h/vcotfiu^ 

(e) A<t^ibf^^*O^5l^^?l0 

(f) ^m. ^m^u (^iii. s&s^afi. sssjsis^s^ 30 
[0 0 13] -r^^t?^. m^^^^^^^xmrn. 

• m^:L^mM^^AyX\^^^h(ot \^xhX\^^(DX^ 4o 
5o w\z^ ^mmn • v h • mmmt^^tKb^ 

[0014] -eof^^>^i5fefi, iifeS • 

t>-^X. ^tRmjSitmznMtti:<>X^\Zi^mi.XCG 
m^^i¥^-r<>(DX^K> . :rco<i: 9f-bTft^UfcCG 

m^\^^U^f^t^^{ZM^i^i^(DX^^ ^ '^t:zZ(DX 

m^^mi7r^mm\z^^^x^ i^m.m^(om7}^i^tcGm^ 



10 

/ce*5CGg®jf^^|f!5 5tCfeoTf^. CG^ifef^^^ 

4izian^^W)i^i^^^mxn^mm^^vxia^. m 

;t^^2(s:tBffiA355gE^-t^iffiUTV^54^JIS^l 1-9 7 5 6 
2 ^ (i^H 2000-29561 1). ^Jp 2 0 0 0- 
1 9 0 7 2 5\zX^mm^mi^P^'rJ>^{zX^h<Dt U-C 
?) . P RM (Parts Reconstructl 
nMethod) t^VX^^^o 
[0 0 15] ^fj:iz>ib. M^m\zm\^X^^^l.tiMMi^ 
It « r CO ^i^fg) I c m U T ^ 46 $ i^ -C V ^ ^ It « =^ 

^m=^-h*t^^iB^^\^^tA:^^ti^ztX\ ^(om^ 

h^\zM)t-\^xf^i^^m^tix\^^^n^M».!^mmz 
m^^^wmmmmmt^m^x^y)^ -^t^ft^ri-K 
^ife^Mfi. ^mM^^(Dum%:. ^'^\^tLm^±xm 
^nv'-'$'-<-:^^mmt x^x^m-r^m^mmmmm 

^^^mm^n^£^m^m^^t. z(ommk^mzx 
^btitzmn'r-i^m. m^mm^mmmmn^mzx 
nhtitLmy'-^. ^mM±^^^\zxm^titiMm 

[0 0 16] ^^\^^\m^o:>m^mzm'r:bmmi^xti 
(DU^^xx^'tixh(r>m^m\zm'r^mnt. ^ne>^o 

mmzm-3\,^xmm<Dmti^mzxy)Mmm^n^ti!^:b 
ir^mmn^m^mti)^^m^\^xgi^. ^<omn=^ 

- m^a^Mti. WaA:^^^(:i J: D A;^ ^nfi^^^ 

i^x^m-r^m^mm^mmmmn 
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^n<om'^t\.xm^^in. i¥^^inftcGmm\^. cg 

^-^-^_xgl5 7f:iiElt$tL> ^^^fh^o ^tzMmm 

[0 0 181 ^fcy T/i-^^AeJ^^^^fgisi ^;5v^^j:fe 
m$k^'T-^w^^2.\z,x.^xw^-^^^wm ' ^^1^ 

U'^^ CGIIf^(DH#Ji|2^iJ$n-ft:i^< I^C<i: 

-y^-m^^^^m. ^f&-^^oftfet^>m^jiCG®«± 

[0 0 191 Mtr. y T/v^-^A5Xeftl5l#lFPl3r>^l/>tt 
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^S^T-itS^-rmt. C Giii^t^:ii:7 

[0 0 2 0] ^fc^^^?HfeF^tO^SO^^^<^m^T-# 
Tl/^^wi:T% e^7^-^-<-;^l35 3tCjgKUfc^i5f*: 
am§P 1 8 t;i<t oTJK«S5Mfep^(D^EbflcM«<75;^^ttm 

,t<^^i&^UT. ttta-rsr ^'ii-etSo rcoj:5t-a 

^\z,^^f^^\c^ ^^^n\7\^x.ox^<oii.^^5^ 

v^5, z,(Dmm%%\ 1 X\X^ ^Sb^t^ifittilfPi 8{c<j: 

[00 2 1] Bi#-r5«^e!*i«(c*5v>T. 

^w-C% ^«f|5^^<?:>^. P^i: ferns iSrWiEUr. ^ffl^ 
(texture di). #®^) 

$n (2 1) . ^-^^S' h/^:$^Wx »St-cl:5^l9^D{:i 
<tor^^a55^^^*t±ib (2 2) . =r^y^^^-^^-^ 
•f ^fc26(;:-eo5^W^m^i^#-ro (2 3) o ^(o^^ 
\c J: o TfejKffi5>e?5feiaa^tt^S ^ S>i -5 r T-tcoS 

^pfe^as^^amu (2 4) . ^fc^ffifetas^ttaiu 
(2 5) . •ene)Co^?asM^;giuiurMiEo^^<^-r 

hXc^^X. (2 6) . ffl:E^;^^§j^>feft#^tB;/3i-^<^-C 
50 $>-5 (3 OA) o J'jr:fe4iJ^^ra»<^S^<t^l^-:^.^iOe^ 
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tt. M:iEff»^^o7i^-i.$:Tg^u (2 7) , 

^•9^19 (2 8) . ^(Dm^^M^Hn^:it'r^m^-ir 

^ (2 9) oT*fei9> wn{-J:oT«:iE^;?fe«t«^t-^^ 

fcB;^-rSO-C*>5 (3 OB) o 
[0 0 2 2] ^fcCGllilfefi^t0^4®;6^e>. ^t^^J^^ 

i^Jf^fg^ J: o Tm.^^M}65 T* ^ 5 J: p /It o T V > 5 . 
[0 0 2 3] /ce:fe^tRU^-CtiS.^^a:M{;i J: S^:^ i: 

[00 24] ^5cfc;Blfgt;io^U£§gr ^ h , 1 5 

2. cGiii«^^^-r5CG]if««3 3. ^nmkm<o 

^J;tf^^S-MS. S.^;^^e>co^t3;^, ^f^^m^mm 

-f-ill 19 Mil • -f-iH 0 ^51 • -^fl^ih • #^5t«*>6 

>^^^^LTV^^^f^^S3 6. :Nfe.^.t:ij3tt^^S^ 
^^^iirfc?) ( r3 6 0Sj ) . 3DCG^^^$-frfc 
19. ii^eOJit) • T«9CO-^#^^^lR-rS^;^»J«9«3 
7. il^^O^.^. • )^^^ig^t^ttJi-I^tH*^3 8. ft:^ • 
' ®®^iOtf^^(^ff®im^*S3 9. ^JSlJfi^^^4 
OdS|H:iii^:^^tt. ^fc«^^^|^^J.«5:6<jJcJg^i-5^ 

»W«l^fg:^«4 0 AdSKtt^tbT^so. r.ttf>lc^t"r 

[0 0 2 5] /.^isrcD^^i^Ml StCifclt'SMfficOffi® 



ffi«:dWj^-5Ci:tc^JtSLT:Rae)Si«^^«3 1. CG 
ill^«c3 3}^5v^-ri^3!)^-;^o;^^ $ttfcl9. :%0*iE3 2 

S£?5ieft^^«3 1. CG®««3 3;5svN-fix36^— $ 

::ixbl::<t^ii^^5iLi!i^^'5i/MiCG®^ 

[0 0 2 6] ^fc^t^«|$gfci3VNT«> ^<i:ei^coit 

10 m^x^^n^h-^^hx.. )AMM^h\^x(oi^nm'&L 

^^^t^(0^-^ (^^fial^f/.?V>) Xm.^^^t^h(D^ 

Ife (e«i*x— t?-^— x|f53. CGx— 1^-<— ^*P7«(c: 
6T% s5x^<^«iig^#;5^e>a:g^{;ieHfe7'-i5'-<-;^a5 3 

[0 0 2 7] ai^C0^«ISt-:feV^T. f^H^d^ 

^m^^l 0^^^;tTV>o, 
20 [0 0 2 8] ^^f::i5V>Tfi^t7>g6^^#5feSiJfcM3S:ds 

[0 0 2 9] ^hm'^x^mk<Di^%'^j.^\c^ ^^t^-mi 
'^^w&^^mxn'^\.x^%'t^^\t. ^'mm<o^ 

as 1 2 J: !9 ^^m^Wm. b:^^. HSf-Mti^l^SP l 
1 t-A-So 

30 [0 0 3 0] /c^:J3g^^j^I±OittiT*^'5e^^^Jl. ^ 
±, fe^v^^iix>^"ri^^36^e>5ll9Ai^^g^Wfe^S^. lEigff 
3 $ V ^ t^efe^lHdr CO*f it-e 

oiIKt-*5 it ^ 6^5g®lfeA;^ 

^ (f^Jh®. S)M^B3fc>?:?v>) ^i^Mf^fcmD^^. ffi 
wix:£:lt«iHfe^-e>^J«UfcCGB«t^it«i- 

[0 0 3 1 ] Mt^^^*:6^t::lft0^-ro<?r. M^f^t^^^^^ 
50 ^iJ' y 5'i5^^T*fg^LT^^-r^»&&JCtt, JK^SSMfei: 



(9) 
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^JCTciS^^;^ $ tt^ w ^ {c 5 C G ^ 1^ C \zm ^ 

[0 0 3 2] ^fcjui^^iFPi 1 {zx^mi±m^(omm 

T-«. CGM««c3 3}C^;^$n^*ifBfpti;ytS£iJ*e»^ 10 

iy^\z^^xM^m^m'^-r^t^ ^mm^i 
i.x^mMMmkzM)t^'r<>^ • cGmmn^u • jn^^ 

'r^::Lth^mtt^^x\^^^o 

[0 0 3 3] mz^()'^AytdmM^^m:iML^mm\^x. ^ 
«iy'-'$^^-:^^3\^\zwm^^^nxy^^^m^^mm 

UTffi±TitK-rnf^> ^-<->^§t3* 30 

(0 0 3 4] g^T^— ^-<— ;^I55 3F^C^§!;^ 

i2<A.fcit^mm^^cG^W}ip^n 4 ^ fcfi c G i ib 
-<-:^n3\z^:^\^x:is< ztx\ ^o^. it^mmm 

[Hj CfE3£E^^#0)Ki5i'55t«fe^55«i«^7^->5'-<~;^lfP3 

TT^^ cGm^ms 3i^(ocGm&<om^^^t^'^^tfj: 

9. v>-rixt>^^-C^-5Cli:tc?ir-5(^)Xfe'5o so 
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[00 3 5] ^tcmi fc^*r J: 9 t-. i^-b<0 J; 9 tc^^ 

^45 t^^c^-y<-m^mmt ^^^i^i^i otc 
^s^-r5«i5^)is*4 1. mi^mmi s(D:m^-r^m^^ 
*4 2^#;t. r-9m^mi^m4 3^m-r^-(>^^- 

h^mmm^mmx^x^^. z(D^>^-:^iy 
^mm^isn^bv'-^m^m^m^ 3. ±m^—^<-m 
x-^5^i^S'ftifi5 4 5 ^mm i.x-^-y^-m^mmt^m 
mm^^i^x^ ^z-r^ <dx^^. 
[0 0 3 6] 'rt^t>'h^^jc(oi^mmL. r^x^cGU 

^F;gt?;'<?V^) ^6V^^iWe b (World wide 

web) ^iiCXSttU ^tiMmx^^Xo{z^^:^ 
tib^X^^o ^(Oti^^ «»J;t^^iB^H7cfci5V^T«#a^t 

Web TM'g'-rs r b x^m(ommi^-^ 

[0 0 3 7] •^fz.:^^mi^:^'rJ>>^(D^mm^We^h(D 
— ^^^-^l— >?.^3. CGft^a54, 5> CG-7^— 

8 . 1 0 . mff^mm 1 5 (o/>/j^ < b \>—n^ 

S^il^tIHI«|^SV^^iWe b^^^UT^^^Jofe-t-^iDX 
^ii^tSIS. Web^^UTM*ffU Jfem^^-rSOX 

[0 0 3 8] i-/^^:>*>wP't^s:i^r% mk.ytm.^^ M 
jii. MfeiiE^. mi., ^^mx^^mmzwrn-r^ 

^mmn(Dmmy'-^--'(om0:,'M,mwm:^'^b\zn\^x 

m^i,zum\zm^i^^^^h<Dtx'^ So 

[0 0 3 9] MfcS 9 \cm^}<Dmm<Dmmi)^7ri^inX^ 
U%^\zm^^t>^xmiy^\^tzh(oxhO. :i<oi^Vy 

h 4 6y±it^m.f!^^\ZCG\ZXoX^mz^^ y^^^ 

A^fzx 0 \^~'^(omtL^-^(Dmmxm:^(omk±x(D- 



(10) 
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[0040] iry5'h46 (of^m^. mn:^\^(o^m<o 

^n'^:)j<oiKmmi:h^-.^Az\^ox-m'&mm^\z 

m.r)m7\Z.m^'r^CG\:LX^31^7t(0^]) ^> h4 6^ 
h4 ^i)^^%mi:h<OX^fhYl. ^^mMM(0^m. 30 

[0 0 4 1 1 t^^:L<OXb^^^]} 6^;^H. •e<7> 

[0 0 4 2] i^\zm^^m. mi±mm. t(Dm<oi^m(D 

;^v(omfkmmm^cGmmt\.x^ ^(omm^nrnx 
t^mm.^^i:^'f—^^—:^U3\zmm\^x^^. ^tz 
c Gm^^(K>M^mtt(om^'^y^-^ ^B.m\zmmx 
^ ^ ct 9 -Miz^i^ bn^m^i^^^^xi^^^ :it^m 
mz&iT(o^iim^n o (ox^^, so 
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loo 4 3] m^^mm-mst. ^ximm\zm-^<&.m 
mmtmmvxmm-t^m^\z\t^ ^T<omm\zx^o 

(1) ^^^si 5\zm^^tirziki^^^m^^3 i. m 

0«3 2. CGili««3 3l^(:ii3ttC)^^ii^<oy r/u 

(2) M&m^t^vyi^^tifcm^(07u—J^xo:ij^7 
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* NOTICES * 

JPO and MClPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image information retrieval system which acquires and displays a situation image 
and is characterized by indicating by retrieval the object within a situation image, and the 
attribute data made to create and register into an object beforehand mutually by photoing the 
path situation which should be searched, moving at the path concerned. 
[Claim 2] The image information retrieval system characterized by to carry out CG 
(KOMBYUTAGURA fix) imaging, to display various kinds of objects currently photoed in this 
situation image, and to indicate by retrieval the object in a situation image or CG image, and the 
attribute data made to create and register into an object beforehand mutually while acquiring and 
displaying the situation image by photoing the path situation which should be searched, moving at 
the path concerned. 

[Claim 3] A situation image is acquired by photoing the path situation which should be searched, 
moving at the path concerned. While carrying out CG imaging and displaying various kinds of 
objects currently photoed in this situation image, the map or aerial photograph of the path 
concerned is displayed The object in the inside of CG image, a map, or aerial photograph, The 
image information retrieval system characterized by indicating mutually the attribute data made 
to create and register into an object beforehand by retrieval. 

[Claim 4] A path is an image information retrieval system according to claim 1 to 3 which are a 
route, a river, a sea route, a depths-of-the-earth way, an orbit, an air route, etc. 
[Claim 5] A situation image is an image information retrieval system according to claim 1 to 4 
made into the thing of a dynamic image or a continuation static image. 

[Claim 6] A situation image is an image information retrieval system of a real-time image and the 
record image which carried out acquisition creation beforehand according to claim 1 to 5 made 
into either at least. 

[Claim 7] While displaying the point location of the displayed situation image on a map or aerial 
photograph, only the lat/long and altitude, or lat/long of a point location is the image information 
retrieval system of distance and a point name according to claim 1 to 6 equipped with one of 
index information at least from the criteria ground. 

[Claim 8] The image database section which carries out preservation record of the situation 
image, and CG creation section which carries out CG imaging of the situation image, CG 
database section which carries out preservation record of the data by which CG imaging was 
carried out, and location bubble ******** to which the situation image of image database circles 
and CG image both of CG database circles are made to correspond, The object attribute 
database section which carries out preservation record of the attribute data of the various 
objects in CG image currently recorded on CG database circles. The image information retrieval 
system characterized by having a search method, the retrieval specification part which specifies 
the object for retrieval, . and a situation image, CG image and the display that displays a retrieval 
result, and changing. 

[Claim 9] For the display image in the area within situation graphic display which indicates a 
situation graphic display region, a map region, and the CG image region by the partition, and 
displays a situation image, and CG image in the area within CG image which displays CG image, a 
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display is an image information retrieval system according to claim 8 corresponding to the point 
on the map in the area within a map which corresponds mutually and displays a map or aerial 
photograph, or aerial photograph. 

[Claim 10] The same point as CG image which synchronized so that a point might correspond to 
the display in a situation image, The object which displayed independently by selection 
simultaneous in piles so that CG image of the same viewing angle might be put in order or a 
location and an object might agree, and was displayed within CG image by carrying out selection 
assignment directly The image information retrieval system according to claim 1 to 9 which 
displays the attribute and data of the object on a screen, or has displayed the LAT of a point, 
and LONG simultaneously. 

[Claim 1 1] It is displayed with a free view that CG image moves to a motion of the object within 
a situation image synchronously so that a point may be included Express CG image as a free 
view independently, without displaying the location of the object within a situation image in CG 
image, or synchronizing by selection, and the object in CG image by or the thing for which 
selection assignment is specified directly The image information retrieval system according to 
claim 1 to 10 which has displayed the attribute and data of the object on the screen. 
[Claim 12] The image information retrieval system according to claim 1 to 1 1 which measures 
distance, area, and the volume and has displayed them on the screen by specifying the object in 
a situation image or CG image. 

[Claim 13] Like CG image, the view [ image / situation ] within a situation image is changed and 
displayed, or CG image is treated like a situation image, both are made applicable to retrieval fair, 
and it is a certain image information retrieval system according to claim 1 to 12 which it is and is 
used as the entry of retrieval. 

[Claim 14] The image information retrieval system according to claim 1 to 13 currently displayed 
as CG image in piles in the map or aerial photograph displayed synchronizing with a motion of the 
point displayed with the situation image. 

[Claim 1 5] A retrieval specification part is an image information retrieval system according to 
claim 8 to 14 which enables it to have searched the object with which a search method and the 
object for retrieval are specified, the retrieval conditions of a situation graphic display region, a 
map region, and CG image region which contain the part or plurality of an object by either at 
least are specified, and it is satisfied of those conditions. 

[Claim 1 6] A retrieval specification part is an image information retrieval system according to 
claim 8 to 1 5 which specifies a search method and the object for retrieval, makes applicable to 
retrieval the situation image of image database circles photoed in the same location as the new 
image, or CG image of CG database circles by making applicable to a comparison the new image 
acquired independently, and makes the location on a map or aerial photograph applicable to 
retrieval further. 

[Claim 1 7] It is the image information retrieval system according to claim 1 to 1 6 which the data 
of the new image acquired independently are making it correspond as compared with the 
situation image of image database circles, or CG image of CG database circles, and the data of a 
new image acquired the three-dimensions coordinate from the situation image data ****** CG 
image, and is equipped with the updating image data division which update the situation image of 
image database circles by the acquired coordinate, and carry out record-keeping to the image 
database section as updating data. 

[Claim 1 8] Updating data are an image information retrieval system according to claim 1 7 
considered as a juxtaposition display or a change display as parallel data which makes a 
coordinate the same. 

[Claim 19] The image of the null part which deleted the mobile image currently displayed within 
the situation image, and was hidden in the mobile of the deleted part is an image information 
retrieval system [ equipped with the image complement section sticks in three dimensions, and 
complements and it was made to display from other image frames ] according to claim 1 to 1 8. 
[Claim 20] An image information retrieval system [ equipped with the image complement section 
which extracted only the shade part of the object currently displayed within the situation image, 
made the brightness of a shade part, and a color temperature same extent as a perimeter, is not 
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conspicuous and was made to carry out a boundary with a perimeter ] according to claim 1 to 
19. 

[Claim 21] The image information retrieval system according to claim 1 to 20 which was made to 
indicate the object and attribute data within a situation image by retrieval through a 
telecommunication circuit or Web. 

[Claim 22] The image database section, CG creation section, CG database section, location 
bubble the object attribute database section, a retrieval specification part, and some 

displays [ at least ] are the image information retrieval system according to claim 8 to 21 by 
which the connection configuration is carried out through a telecommunication circuit or Web. 
[Claim 23] The image information retrieval system according to claim 1 to 22 which has made 
various information on the various data and others in the work process and work process for the 
index information for the retrieval in the point location on various kinds of attribute data about a 
situation image, CG image, various kinds of objects, and its object, map data, a map, or aerial 
photograph, and situation image creation the thing in which offer thru/or acquisition is possible 
through the telecommunication circuit. 

[Claim 24] The image information retrieval system according to claim 1 to 23 which has displayed 
the shot of fixed spacing which makes the distance, the area, and the volume in a actual 
situation the displayed situation image measurable visually or in piles in non-vision. 



[Translation done.] 
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1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image information retrieval system which 
enabled it to perform simply actual condition grasp of the perimeter situation in the 
predetermined point which faces management maintenance of the route and the river, and others 
in tubing in retrieval of perimeter situations, such as a transit point for example, in a car 
navigation system, and an arbitration point, a route, a river management engine, etc. 
[0002] 

[Description of the Prior Art] Car navigation is carried in many cars on account of the 
convenience of being able to arrive at the destination easily by following recently advice of the 
map retrieval displayed by the navigation system on the occasion of transit by an automobile etc. 
Moreover, while enabling it to have plotted mostly at accuracy on the map which had its location 
displayed by the location retrieval by GPS, the signal which is various-kinds-fumished and is 
installed on the map, and others are displayed on the navigation system currently generally 
offered, and a bird's-eye view can be displayed on it depending on a system. 
[0003] On the other hand, in the route and the river management administration building which 
manages a route, a river, etc., the actual condition of the route in tubing etc. is grasped, and in 
order to aim at the suitable management, the present condition video retrieval equipment which 
these people have proposed, such as a route, a river, etc. according to patent No. 30991 03 for 
example, is used While enabling it to search promptly with this retrieval equipment a dynamic 
image about a perimeter situation, a continuous static image, etc. of the route which took a 
photograph serially and was acquired to running a route etc. actually by displaying as a thing in 
that arbitration point it is made to give a related indication also of the situation of the various 
facilities in that point, and administrative various facility drawing and records, and others. 
[0004] 

[Problem(s) to be Solved by the Invention] However, it is only displaying the location offer 
example, a seH^vehicle, a surrounding facility, the destination, etc. superficially or in three 
dimensions on a map, and the object for retrieval in the conventional navigation system 
mentioned above is the map information itself. Therefore, if it is in transit advice of car 
navigation, since it is difficult, in a short time while comparison with map information and a actual 
situation runs in directions of the travelling direction in the complicated crossing which has 
crossed diagonally and become complicated, for example, it is a certain thing plentifully to 
mistake a travelling direction. 

[0005] Moreover, grasp of whole information [ in / though a dynamic image etc. is searched with 
present condition video retrieval equipment, since a field angle and a direction are restricted / 
the route ] was difficult, and since the location and data of each object moreover were not 
obtained by accuracy, it was not enough for management of the incidental facility, facility, etc. of 
a synthetic route. 

[0006] Then, this invention is what was created in view of many situations which consisted 
conventionally like the above statement. The three-dimensions information which situation 
images, such as a dynamic image, a continuation static image, etc. of the actual situation in the 
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various paths of a route and a river, and others, have Relate with the positional information in 
area maps, such as a map and aerial photograph, and it three-dimensions-izes. By building the 
database of the various objects which reconfigurate the various objects by which a recognition 
extract is carried out in three-dimensions information as a CG image in that case, and are 
included in a situation image It not only displays the object for retrieval on a map, but it displays 
in an image, and it extends so that retrieval in the object in the three dimensions information in 
an image by which CG generation was carried out accord to the data of a name, a location and 
an attribute, and the combination and others of them for example may moreover be enable. 
Those the retrieval of various kinds of It aims at offering the image information retrieval system 
which gives an indication possible. 
[0007] 

[Means for Solving the Problem] If it is in this invention in order to attain the object mentioned 
above, by photoing the path situation which should be searched, moving at the path concerned, a 
situation image is acquired and displayed and rt is in having been made to indicate mutually the 
object within a situation image, and the attribute data made to create and register into an object 
beforehand by retrieval. Moreover, while acquiring and displaying a situation image by photoing 
the path situation which should be searched, moving at the path concerned, CG 
(KOMBYUTAGURA fix) imaging is carried out, various kinds of objects currently photoed in this 
situation image are displayed, and it is in having been made to indicate mutually the object in a 
situation image or CG image, and the attribute data made to create and register into an object 
beforehand by retrieval. Or a situation image is acquired by photoing the path situation which 
should be searched, moving at the path concerned, while carrying out CG imaging and displaying 
various kinds of objects currently photoed in this situation image, the map or the aerial 
photograph of the path concerned is displayed, and it is in having been made to indicate mutually 
the object in a map or aerial photograph, and the attribute data made to create and register into 
an object beforehand by retrieval in CG image. Moreover, paths are a route, a river, a sea route, 
a depths-of-the-earth way. an orbit, an air route, etc., and a situation image is made into the 
thing of a dynamic image or a continuation static image. Furthermore, while displaying the point 
location of the situation image displayed by considering as either at least of a real-time image 
and the record image which carried out acquisition creation beforehand on a map or aerial 
photograph Only the lat/long and altitude, or lat/long of a point location From the criteria ground 
to distance a point name (the 2-dimensional coordinate on the distance from the origin of a 
route, and a map, or a three-dimensions coordinate — ) It can consider as the thing of the name 
and others of the two-dimensional coordinate of one point of the numeric value of the distance 
from a certain specifying point, and the arbitration on map ****** aerial photograph, the point 
name of a route, and the name of a place on a map equipped with one of index information at 
least. The image database section 3 which carries out preservation record of the situation image, 
and CG creation sections 4 and 5 which carry out CG imaging of the situation image. CG 
database section 7 which carries out preservation record of the data by which CG imaging was 
carried out. and location bubble ******** 9 to which CG image both in the situation image in the 
image database section 3 and CG database section 7 are made to correspond. It has the object 
attribute database section 8 which carries out preservation record of the attribute data of the 
various objects in CG image currently recorded in CG database section 7. a search method and 
the retrieval specification part 10 which specifies the object for retrieval, and a situation image. 
CG image and the display 15 that displays a retrieval result, and changes. A display 15 is made 
with the thing corresponding to the point on the map in the map region 32 which the situation 
graphic display region 31. the map region 32. and the CG image region 33 are indicated by the 
partition, and the display image in the situation graphic display region 31 which displays a 
situation image, and CG image in CG image region 33 which displays CG image correspond 
mutually, and displays a map or aerial photograph, or aerial photograph. Moreover, the same point 
as CG image which synchronized so that a point might correspond to the display in a situation 
image, The object which displayed independently by selection simultaneous in piles so that CG 
image of the same viewing angle might be put in order or a location and an object might agree, 
and was displayed within CG image by carrying out selection assignment directly The attribute 
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and data of the object are displayed on a screen, or the LAT of a point and LONG can be 
displayed simultaneously. GG image is independently expressed as a free view, without displaying 
with a free view that CG image moves synchronously, displaying the location of the object within 
a situation image in CG image, or synchronizing by selection so that a point may be included in a 
motion of the object within a situation image, and the attribute and the data of the object can 
display on a screen by specifying selection assignment for the object in CG image directly. By 
specifying the object in a situation image or CG image, distance, area, and the volume are 
measured and they can be displayed on a screen. Like CG image, the view [ image / situation ] 
within a situation image can be changed and displayed, or CG image can be treated like a 
situation image, and both are made applicable to retrieval fair, and it can be and can consider as 
the entry of retrieval. The map or aerial photograph displayed synchronizing with a motion of the 
point displayed with the situation image can be displayed as CG image in piles. The retrieval 
specification part 1 0 enables it to have searched the object with which a search method and the 
object for retrieval are specified, the retrieval conditions of the situation graphic display region 
31, the map region 32, and CG image region 33 which contain the part or plurality of an object by 
either at least are specified, and it is satisfied of those conditions. Moreover, the retrieval 
specification part 1 0 can specify a search method and the object for retrieval, can make 
applicable to retrieval the situation image in the image database section 3 photoed in the same 
location as the new image, or CG image in CG database section 7 by the ability making applicable 
to a comparison the new image acquired independently, and can make the location on a map or 
aerial photograph applicable to retrieval further. The data of the new image acquired 
independently are making it correspond as compared with the situation image in the image 
database section 3. or CG image in CG database section 7. The data of a new image acquire a 
three-dimensions coordinate from a situation image data QG image. The situation image 

in the image database section 3 is updated by the acquired coordinate. It can have the updating 
image data division 1 6 which carry out record-keeping to the image database section 3 as 
updating data, and updating data can be considered as a juxtaposition display or a change display 
as parallel data which makes a coordinate the same. The image of the null part which deleted the 
mobile image currently displayed within the situation image, and was hidden in the mobile of the 
deleted part can be stuck in three dimensions from other image frames, and can be 
complemented, and it can have the displayed image complement section 1 7. Only the shade part 
of the object currently displayed within the situation image can be extracted, and it can have the 
image complement section 1 7 which made the brightness of a shade part, and a color 
temperature same extent as a perimeter, is not conspicuous and was made to carry out a 
boundary with a perimeter. It is the electrical and electric equipment about the object and 
attribute data within a situation image. It is made to indicate by retrieval through a 
communication line or Web (World wide web), and the image database section 3. CG creation 
sections 4 and 5. CG database section 7. location bubble 9, the object attribute 

database section 8, the retrieval specification part 10. and some displays [ at least ] 15 are made 
with that by which the connection configuration is carried out through a telecommunication 
circuit or Web. Furthermore, let various information on the various data and others in the work 
process and work process for the index information for the retrieval in the point location on 
various kinds of attribute data about a situation image. CG image, various kinds of objects, and 
its object, map data, a map. or aerial photograph, and situation image creation be the things in 
which offer thru/or acquisition is possible through a telecommunication circuit Moreover, the 
shot of fixed spacing which makes measurable the distance, the area, and the volume in a actual 
situation shall be displayed on the displayed situation image visually or in piles in non-vision. 
[0008] In the image information retrieval system concerning this invention constituted as 
mentioned above For example, the comparison with the situation image after [ actual ] setting to 
various paths, such as a route, and CG image which carried out CG imaging of this. The point on 
various kinds of objects in a situation image and CG image both, and also a map and aerial 
photograph etc. is made to search mutually, moreover, various kinds of attribute data about an 
object etc. is displayed — making — as a car-navigation system — under transit real 
transit advice by comparison with a view and a situation image is made smooth, and various 
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kinds of management information in management of a route etc. is made to acquire promptly The 
retrieval by the retrieval specification part 1 0 enables assignment of various retrieval conditions, 
for example, is made to depend it on various kinds of point indexes, the attribute data of an 
object etc., and the image frame and image frame by which record-keeping is carried out into 
the image database section 3 in which the point corresponding to it and the object exist, and CG 
database section 7 etc. are displayed by independent or plurality. Modification of the free view in 
the situation image displayed by the situation graphic display region 31 and CG image displayed 
by CG image region 33 makes the new situation image and CG image containing the object image 
from the changed view generate using the attribute data of the object in the changed view etc., 
and enables acquisition of various status tracking, management information, etc. Measurement of 
the distance, the area, and the volume by assignment of the object in a situation image and CG 
image makes the gestalt of the path part of the arbitration for the management in a path 
management engine etc. grasp beforehand on a screen, for example, makes speeding up of 
various activities, such as maintenance, inspection, etc. in a site, attain. The situation image 
frame by which record-keeping is carried out into the image database section 3. and CG image 
frame by which record-keeping is carried out into CG database section 7 enable updating by the 
updating image data division 16 after the comparison contrast with the situation image which was 
made to enable comparison contrast between them, and was newly acquired. Complement 
correction of the situation image by the image complement section 17, CG image, etc. makes the 
shade part which is made to delete the mobile image like various kinds of cars which consist in a 
situation image and CG image, and accompanies an object eliminate, and makes the situation 
image of the primitive situation that the extraneous article in a path does not exist, and CG 
image generate. The attribute data of the object within a situation image by indicating by 
retrieval through a telecommunication circuit and Web A user may be made to offer the newest 
data with which the various information relevant to a path, and various objects and others was 
updated serially. The image database section 3 which makes these, CG creation sections 4 and 
5. CG database section 7, location bubble ****** * * 9, the object attribute database section 8. 
the retrieval specification part 1 0, and some displays [ at least ] 1 5 by carrying out a connection 
configuration through a telecommunication circuit or Web Moreover, both remote places But the 
activity of renewal of data etc. is done smooth in different **. and a user is made to enable the 
acquisition of the newest data to instancy. Moreover, offer thru/or the acquisition of various 
information which led the telecommunication circuit is updating the various information relevant 
to the path which changes at every day as the newest thing, and makes a user make the newest 
information available serially. The visual and non-vision-shot 46 displayed in piles into a situation 
image enables viewing of measurement of the magnitude of the distance between the every 
place points in a situation image, height, and an object and others etc., or it may be made to ask 
for it by automatic count. 
[0009] 

[Embodiment of the Invention] The image information retrieval system by this invention hereafter 
to explain the gestalt of operation of this invention with reference to a drawing The path which 
should be searched, i.e., a route, a river, a sea route, a depths-of-the-earth way. an orbit, the 
automobile of an air route and others. The actual situation of the path prepared for various 
mobiles, such as a marine vessel and an aircraft, the traffic traffic which human being moves 
further is gone up. The dynamic image and continuation static image which carried out record- 
keeping by carrying out photography acquisition by transit, NAV. etc. by going down, and 
generated CG (KOMBYUTAGURA fix) image are searched. The thing or the thing recorded 
beforehand of the real time which is this time in the path where a dynamic image, a continuation 
static image, CG image, etc. are actual. Or the view location which is generated CG image and 
searched in those situation images is shown on a map. Or it is as follows, when it is shown in 
those images, it displays by specifying the object within a situation image further with attribute 
data, such as combination of name, location, and attribute - and an attribute.. and drawing 
explains these outlines. 

[0010] The sign 1 shown in drawing is the real-time image acquisition section, it acquires with a 
camera the situation image acquired by this time in a path in a view location, digitizes it. and 
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sends it to the image database section 3. Moreover, in this image database section 3, record 
creation of the situation image of the path recorded beforehand is carried out and a 
predetermined image is sent also from the record image data acquisition section 2 to save. 
[0011] In the image database section 3. if there are the kilo label, the LONG and the LAT. and 
also need from for example, a path radix point for a certain retrieval which shows the criteria 
location of each image in the acquired situation image, it has various kinds of index information, 
such as name indexes, such as a name of the point in numerical indexes, such as altitude, a path, 
etc.. and these are related with the situation image. And the situation image shall have acquired 
positional information by combining those index information with the coordinate of the map in a 
map and the aerial photograph database section 6. and aerial photograph eventually, and carrying 
out like this. 

[0012] On the other hand, as for the situation image in the image database section 3. CG manual 
creation section 4 which CG imaging is carried out like the formation of 3DCG (three-dimension 
computer graphic: three-dimensional CG three dimensional computer graphics) or 2-dimensional 
imaging, and carries out CG imaging by the manual operation by handmade [ of the operator for 
it ]. or CG automatic creation section 5 CG-ized automatically is formed In these CG creation 
sections 4 and 5. if the various objects with which it consists in a situation image are put in a 
database and the example of an object is given, it is as follows. 

(a) Distinction of those other than people and a man (b) Distinction of those other than a vehicle 
and a vehicle (c) It considers as distinction / migration body of migration bodies other than 
people, and a quiescence body. :car. It considers as the thing and quiescence body which a light 
vehicle and a quiescence body do not move in addition expect :road sign. As - quiescence 
bodies, such as a route display, a route facility, and work advice, rsignboard. a telegraph pole, a 
tree. As - buildings, such as the earth, a crest the sea. a river, the sun. the moon, other celestial 
bodies, and clouds. :gas station. A repair shop, a convenience store, police station (d). etc. It is 
addition (e), using measurement of the velocity vector of a migration body, and an acceleration 
vector as an attribute. Future prediction of people and a migration body (f) The weather, road 
surface situation (information acquisition of atmospheric temperature, road surface temperature, 
road surface coefficient of friction, etc.) 

[0013] Namely, for example, the object recognized and specified in a route image The route 
equipment of a route side, a road sign, a guide sign, a street LGT, a traffic sign painted on the 
road, a guard rail, and street tree others, Are the route circumference structure of a building, a 
residence, a store and a signboard, and others, and the attribute data about an object it is one 
good also as a thing including those images that carried out photography acquisition with regards 
to the installing point of such route equipment and a route circumference structure, and the 
data, related engineering drawing and the related work hysteresis relevant to this image. 
Furthermore, accommodations, the sightseeing point a store, etc. can also include the image 
which carried out the photography acquisition of them. 

[0014] It is the description to lap with a situation image thoroughly and to pile up in this way. and 
it is also important for CG image which the creation approach piled up the map and aerial 
photograph, and situation image in a map and the aerial photograph database section 6. judged 
that the same view as a situation image came, and created CG image, and carried out in this way 
and was created. Therefore, even if viewport of a situation image and viewport of CG image may 
be made only into either in the display screen and only either is displayed, and it is piled up 
substantially, for example. [ it ] In addition, if it is in CG automatic creation section 5. it shall 
have the function to perform automatically manual operation in CG manual creation section 4. 
for example, shall be based on the signal transduction system by Japanese Patent Application 
No. No. (JP.2000-295611.A) 97562 [ 11 to ] and application for patent 2000-190725 for which 
these people have already applied, and PRM (Parts Reconstructin Method) is called. 
[0015] Namely, the information code-conversion equipment which changes the object 
information acquired about the object into the information code beforehand registered 
corresponding to this object and transmits or outputs that information code. In the information 
code from this information code-conversion equipment being received or inputted It has the 
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rendering inverter changed into the rendering object information beforehand registered 
corresponding to this information code, and changes. That information code-conversion 
equipment A correlation function operation means for field analysis to analyze the location of 
various objects on the basis of a field information database on the acquired image. An optimal 
coordinate generation means to analyze on the basis of a coordinate code database from the 
result of an operation of this correlation function operation means for field analysis, and to 
generate the optimal coordinate in an image. Moreover, a pretreatment means to perform profile 
processing of the various objects in an image etc. from the analysis in the acquired image. While 
changing into an array code on the basis of field data obtained with the correlation operation 
means for field analysis, such as profile data obtained with this pretreatment means, the optimal 
coordinate data obtained with the optimal coordinate generation means It comparison-contrasts, 
the object information which carried out acquisition recognition with the object data in said 
components warehouse database is chosen, and it is based on a signal transduction system 
equipped with a correlation function operation means for components retrieval to generate the 
information code combined with the array code. 

[001 6] Or an information input means to input the information about a necessary object and 
information about the various objects created beforehand thru/or the part of those, those 
attributes, etc.. The 1st components warehouse which stored the data which coded those 
information, respectively and formed the database, The information code-conversion equipment 
which chooses and outputs the data about the information which carries out comparison 
contrast of the information inputted into said information input means, and the information 
accumulated in said 1st components warehouse, and corresponds, While choosing the 
information reproducing the object which carries out comparison contrast of said 1 st 
components warehouse, the 2nd components warehouse which formed the database similarly, 
and the data outputted from said information code-conversion equipment with the data stored in 
said 2nd components warehouse, and corresponds It constitutes and consists of the information 
rendering inverter which carries out the rendering output of the object with a necessary output 
means based on the information reproducing this object That information code-conversion 
equipment A correlation function operation means for field analysis to analyze the location on 
the basis of the database of field information on an image about the information about the object 
inputted by the information input means. An optimal coordinate generation means to analyze on 
the basis of the database of a coordinate code from the result of an operation of this correlation 
function operation means for field analysis, and to generate the optimal coordinate in an image, A 
pretreatment means to perform profile processing of the various objects in an image etc. from 
the analysis in an image, It has a correlation function operation means for components retrieval 
to generate the information code combined with this array code while generating an array code. 
Said correlation function operation means for components retrieval While it is based on data, 
such as a profile obtained by said pretreatment means, the field data obtained with the 
correlation operation means for field analysis, the optimal coordinate data obtained by the 
optimal coordinate generation means, respectively and cconverting it with an array code 
Comparison contrast of the information on the object inputted as the information accumulated in 
the database in said 1st components warehouse is carried out. Information in agreement is 
chosen, and while corresponding to this selected information, respectively, it is based on the 
signal transduction system which constitutes and changes so that the information code 
combined with said array code may be generated. 

[0017] The CG-ized whole image which was created by these CG creation sections 4 and 5 is 
constituted as a set of the components of CG image created for each object of every about 
various kinds of objects in a situation image, and created CG image is memorized and saved in 
CG database section 7. Moreover, the various data of an object are saved in the object attribute 
database section 8, classify them for every object, they become possible [ giving an attribute to 
each components ], enable retrieval of each component of each by attribute data, such as 
combination of the name of an object, an attribute, and an attribute, the position coordinate of 
those, etc., and are made to correspond with a situation image, or it enables it to have displayed 
them into the image. 
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[001 8] Moreover, at the time of photography, the coordinate is already attached for every frame 
of a situation image, or 1 in a map and a corresponding code are attached, and the situation 
image by the animation, continuation still picture, etc. acquired by the real-time image acquisition 
section 1 or the record image data acquisition section 2 supports CG image creation time with 
each frame of a situation image further. Therefore, since it is unifying thoroughly as data, a map, 
a situation image, and CG image will always have response relation, always correspond and can 
be displayed. When it is made to have unified thoroughly and. as for this, three persons send it to 
the display control section 14 by location bubble 9. it is constituted by the format of a 

display appropriate for the object and is made for the display to have become possible with the 
display 1 5 like a display. In addition, a situation image is explained as long as there is no need 
especially in the gestalt of this operation, since explanation with the same said of other CG 
images and a map is possible for three persons of a map, a situation image, and CG image 
completely being able to treat similarly, without being distinguished, and explaining a situation 
image. Especially a situation image and CG image are piled up and directions of the object by the 
mouse pointer in the specification 1 5 of the object on a situation image, for example, a display, 
etc.. and a profile and others turn into the same directions on CG image. 

[0019] Furthermore, the newly incorporated new situation image is put in a database by the real- 
time image acquisition section 1 or the retrieval image input section 12 in the image database 
section 3, and it is made to be saved as data of the situation image updated by it at the updating 
image data division 1 6. On the occasion of updating, an image coincidence technique can perform 
image retrieval, as for the situation image data newly incorporated by response relation being 
called for. the coordinate can be received from the old situation image, and with CG image and 
an image coincidence technique, since there is no constraint of a frame in CG image, comparison 
**** can acquire the Niiza label as compared with a continuous coordinate. Since the new 
situation image which acquired the coordinate has the semantics of renewal of an old situation 
image, it can indicate by juxtaposition, or a situation image which can also contrast an old and 
new situation image, for example, is different in a summer and winter can be changed and 
displayed. 

[0020] Moreover, by the ability of various kinds of objects within a situation image to be 
recognized, the mobile extract section 1 8 coordinated with the image database section 3 can 
extract only the mobile image within a situation image, therefore monochrome for example, other 
than a quiescence object is defined as a mobile image, an extract is also possible, and the mobile 
image itself can also be recognized and extracted. Thus, the image with which a mobile does not 
exist can be created by deleting the extracted mobile image from a situation image. In order that 
an applicable part may merely remain in the shape of a null after deleting a mobile image if it 
remains as it is, he is trying to complement the part hidden in the mobile which is the null part by 
the image complement section 17. In this image complement section 17, since the deletion which 
carried out extract deletion by the mobile extract section 1 8 is always moving from the property 
of a mobile, it uses that that deletion, for example, the coordinate of a route side image, is 
already known, a route side is cut out from the frame to which the route side of other images 
has come out of that coordinate part in three dimensions, and it complements with sticking on a 
null part in three dimensions. 

[0021] In the situation image to acquire, when managing with the management engine which 
manages a path, i.e., a route, and shading is in the perimeter of a path, the shading part falls 
black, it may be hard to see and inconvenience may produce it on management Then, it is made 
easy to manage by performing the same amendment processing throughout a shade part, and it 
not being conspicuous and carrying out the boundary of a shade part and a perimeter so that 
only a shade part may amend an illuminance and a color temperature, and can become the same 
method of vanity as a perimeter and the descriptions (texture: surface texture, special feature, 
etc.) of a texture may not be lost of course. Namely, if it explains with reference to drawing 2 
about this shading complement treatment process, an image image input is carried out. and since 
a shading part is extracted and (22) and a texture are saved by the cutoff by (21). the analysis of 
a spectrum, and brightness, it saves by performing that analysis (23). By the analysis, the color 
temperature of a shading part extracts the criteria color temperature by differing from a 
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perimeter, extracts (24) and a perimeter color temperature, detects (25) and those color 
temperature differences, and sets them as the object of amendment. Subsequently, it 
complements about a surrounding color temperature and reinforcement by making a shading part 
into three dimensions, and (26) and an amended video signal are outputted (30A). In addition, it is 
that of (29) complemented with choosing a frame with amendment information, cutting off (27) 
and an image, and sticking (28) and its image with the image of the same point where exposure 
time bands differ etc. when the information on a shading part is acquirable from others, and an 
amended video signal is outputted by this (SOB). 

[0022] From the property, CG image can express a situation image as a free view, and, moreover, 
sets it to this invention. It is possible to stick a situation image on CG image, and since the , 
situation image and CG image by the animation lap thoroughly, then, it can say that the situation 
image was three-dimensions-ized so to speak, and this three-dimensions-ized situation image is 
the same principle as CG image, and can also change a view freely. That is, it has come to be 
able to perform view modification with selection directions of a click of the icon of the shape of 
an arrow head for view modification in view modification control area 33A etc. with the map 
displayed in relation to the situation image currently displayed as shown in drawing 4 . 
[0023] In addition, although a three-dimensional display is impossible with all views since there is 
a part which serves as a dead angle by the view location with a situation image, it is being able 
to stick the texture from other views as a CG image, since three-dimensions-izing is possible 
about a quiescence object because the camera for the photography which is a view location 
moves, and modification of a viewing angle becomes possible in the remarkable range. 
[0024] Next if it explains per retrieval, it will refer to selection directions of the click by the 
mouse pointer in each area displayed with a display 15 etc., and will enable it to have displayed, 
namely, in the display screen in a display 1 5 Are real time or the situation image beforehand 
acquired as shown in drawing as a dynamic image or a continuation static image The index 
information, for example, lat/long. of the situation graphic display region 31 displayed, the map 
region 32 which displays a map, CG image region 33 which displays CG image, the retrieval result 
viewport 34 which displays the content of the retrieval object, and the retrieval ground. 
Classification which displays the kilo label from a radix point, a block-distance display, etc., such 
as the index information retrieval region 35, and a summer, winter. Right-of-way selection and 
name of a place retrieval, for example, advance of the dynamic image and continuation static 
image in the situation image serially displayed with transit, Display the perimeter enclosure in the 
actuation region 36 and point which show the slider type click carbon button which carries out 
slide adjustment of retreat / rapid-traverse advance / rapid-traverse retreat, a halt and 
reproduction speed, or the display point, or ("360 degree"). A partition indication of the 
measurement directions region 39 for measurement of the call region 38 which calls the starting 
point and the terminal points which are made to display 3DCG or choose going up. a change from 
which it gets down of a path, such as the display-control region 37 and a path, the volume, 
distances, area, etc.. etc.. and the printing directions region 40 is given. Moreover, concrete 
retrieval directions region 40A which directs the object for retrieval concretely is prepared, and 
it directs and enables it to have controlled the actuation to these for example, by mouse click 
actuation to the pointer which moves on a screen. 

[0025] In addition, corresponding to the example of arrangement of the screen in this display 15 
not being limited to this, especially being able to change that partition magnitude, and the 
location and others of each viewport into arbitration, and retrieval / display modes differing, the 
situation graphic display region 31 and CG image region 33 shall not be made only into either, or 
shall not display the map region 32. Since the situation image or CG image by these is piled up 
substantially, you may make it change and display it, when the situation graphic display region 31 
and CG image region 33 are made into either from the first. 

[0026] Moreover, retrieval by the comparison of an image and an image is also enabled in the 
retrieval. The image (image which does not exist in the image database section 3 and CG 
database section 7 grade) from the outside is directly inputted for the retrieval image as a 
comparison image with a certain means (a means is not chosen). It acquires in the retrieval 
image input section 12 which treats it as a comparison image, then, the inside of the image 
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database section 3 is directly searched with the updating image data division 16 from the 
retrieval conditions of an image, and a coincidence image is searched for. 

[0027] On the other hand, in the usual image retrieval, it has the retrieval specification part 10 
grade as an operating part for an operator to specify the approach and object of retrieval. 
[0028] In retrieval, processing is divided according to the object and technique. It is processed in 
retrieval with the image itself and the image itself, and the image retrieval section 1 3. 
[0029] When you need recognition of an object first without letting the image retrieval section 
13 pass when specifying and searching with a direct name etc. the case of the retrieval which 
clicks the object in an image and GG image directly, and an attribute in addition to retrieval of an 
image with an image, and it does not need recognition of an object, after recognizing an object by 
the image retrieval section 1 2, it goes into the attribute retrieval section 1 1 directly. 
[0030] In addition, the image retrieval which is the comparison of images compares with the 
image database section 3 the image adopted from the outside of various kinds of images by 
which are recording presen/ation is carried out, or a system by the updating image data division 
16. For example, it is comparison of all the images saved in the image database section 3. 
Extract the modification part of the image of the same old and new point by this, judge updating 
necessity, and For example, when adopting the photograph of the accident site in a certain route 
in the retrieval image input section 1 2 from the exterior. When the accident site point is 
unknown, the image of situation photography of an accident site and the image data stored are 
contrasted, and it enables it to pinpoint the point of an accident site. The photography image (a 
still picture and an animation are not asked) of an accident site is incorporated in equipment, it is 
comparing CG image which generated the configuration and relative coordinate of an object 
within an image by carrying out CG imaging in the same process as a compared image, including 
modification of a view, and generated this from the comparison image, and it becomes the 
comparison of three dimensions and. specifically, retrieval is made possible. In addition, this is 
possible similarly in a dynamic image. 

[0031] furthermore, if it explains concretely, in specifying and searching the object in an image 
with a click etc. Even if only the situation image is to be displayed after the situation image and 
CG image have lapped thoroughly For example, clicking actually will click each part article in CG 
image which is behind a situation image as effectiveness, even if it is an object in the displayed 
situation image in the situation graphic display region 31. That is. this is because a situation 
image can be treated similarly [ even if it is 2-dimensional from the first ] to CG image by 
which three-dimensions image display will be carried out. 

[0032] Moreover, in retrieval of the attribute assignment by the attribute retrieval section 11, 
since each part article displayed on CG image region 33 supports the object displayed on the 
situation graphic display region 31, if an object is specified by click, the image. CG image 
components, and the attribute corresponding to a retrieval object can be detected through the 
retrieval specification part 10, and it can display with location bubble ******** 9, the display 
control section 14. and a display 15. Moreover, since the object attribute database section 8 can 
detect components with the attribute in CG image region 33 when an attribute is specified, the 
object in the situation image in the situation graphic display region 31 currently displayed on the 
component and its component by lapping can be displayed. Furthermore, since the attribute of 
an object is saved in the object attribute database section 8, it is also possible to specify 
retrieval by compound of the combination of two or more attributes, priority, etc. 
[0033] Specif/ the new image incorporated independently and it faces searching the image by 
which are recording preservation is carried out into the image database section 3. Even if the 
view location and field angle of an image differ from each other by making into comparison 
criteria the image incorporated independently because of said retrieval If the image photoed in 
the same location and the image in which the same object is reflected are regarded as an image 
of the three dimensions which consist of two or more three-dimensions objects and are 
compared, the image which corresponds out of the image database section 3 is searched and 
extracted, and the image which attached and searched the image and response can be displayed. 

[0034] At this time, the image in the image database section 3 is three-dimensions-ized by 
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location bubble ******** 9, Since a response is thoroughly attached with CG image which laps 
with a situation image. CG imaging of the incorporated comparison criteria image is carried out in 
CG manual creation section 4 or CG automatic creation section 5. The three-dimensions- 
physical relationship of the object with which the plurality in an image stood it still is searched 
for. and an image can be searched with searching and extracting a situation image or CG image 
with the same physical relationship as the physical relationship. Or after MPEG's? describing a 
comparison criteria image (image incorporated independently), for example and narrowing down 
with other attributes, directly. MPEG7 also describes the image in the image database section 3, 
and if a response is searched for by searching a situation image with the same description as a 
comparison criteria image within the image database section 3, retrieval will be completed after 
that by saving in the image database section 3. If a response can naturally be found from the 
first, a position coordinate will be acquired, the display of the situation image in the situation 
graphic display region 31 and each display of CG image in CG image region 33 will be attained^ 
and all can be displayed. 

[0035] Moreover, as shown in drawing 1 . it is also possible to enable it to search the image 
information retrieval system constituted as mentioned above using communication lines, such as 
the Internet. That is. the image-information retrieval system body constituted as mentioned 
above is used as the server side main unit with the server side data transceiver section 45, it 
has the retrieval terminal 41 equivalent to the retrieval specification part 10. and the display 
terminal 42 with which an indicating equipment 1 5 corresponds, the Internet terminal unit which 
has the data sender receiver terminal 43 prepares, and it enables it to transmit and receive the 
server side main unit and various information via the data sender receiver terminal 43 in this 
Internet terminal unit, and the above-mentioned server side data transceiver section 45, as 
shown in drawing. 

[0036] Namely, the situation image on actual. CG image which carried out CG imaging of this, 
various kinds of objects, and various kinds of attribute data about the object. The index 
information for the retrieval in the point location on map data, a map, or aerial photograph. 
Furthermore, the various information on the various data and others in the work process and 
work process for situation image creation is offered through a telecommunication circuit (a cable 
and wireless are not asked) or Web (Worid wide web), and it can make it possible to acquire, 
therefore — for example, it stores on the server as a thing of the newest information, boiling 
various information serially and updating it to a distributing agency, various information is offered 
on Web from the server, and it considers as what can distribute the information data newest by 
joining together by Web. 

[0037] Moreover, it is also possible to combine each function in this invention system by 
distribution of Web. and to build a whole system. For example, since the connection configuration 
of said image database section 3 which constitutes this invention system, CG creation sections 
4 and 5. CG database section 7, location bubble ******** 9, the object attribute database 
section 8. the retrieval specification part 10, and some displays [ at least ] 15 is carried out 
through a telecommunication circuit or Web It is, and by this, the information about the path and 
path within a situation image, a related object, and its attribute data and others are updated 
through a telecommunication circuit and Web, and it indicates by retrieval. 

[0038] That is, it can do with the thing to the newest data of the various information relevant to 
the path which are a route, river, sea route, and depths of the earth way, an orbit, an air route, 
etc. in carry out like this which can make it wori^ smoothly even if it faces do an updating 
activity serially and both operators etc. differ from time amount in the remote place, will make it 
update serially simply moreover, will make distribution possible, and may make a user offer it 
immediately. 

[0039] Furthermore, the gestalt of another operation is shown in drawing 9 , and lay a shot 46 on 
top of the situation image in the situation graphic display region 31 in a display 1 5 visually or in 
non-vision in the shape of a mesh, and it is displayed on it This shot 46 is displayed that that 
spacing narrows at the rate of a constant ratio, when it displays that the fixed distance on a 
actual image and fixed height stacked the block on space at intervals of fixed unit length and CG 
converges an image on one point into a situation image. For example, the standard distance line 
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of position of the rectangle of imagination is displayed ahead [ of fixed distance ] from the 
camera station of a situation image like a graphic display. The shot 46 which meets the cross 
direction of suitable unit length, the height direction, and a travelling direction for every fixed 
spacing from the neighborhood shall be displayed in the shape of a grid. By it While the area in 
the distance on a route and the various bodies of an object and others, the volume, etc. are 
easily measurable with viewing or automatic count, concrete setting out of the view modification 
location to an object can also be made to perform simply. In addition, this shot 46 of it being 
possible not only when displaying in piles on the situation image in the situation graphic display 
region 31, but to display on CG image in CG image region 33 is natural. 
[0040] The field of upper predetermined height with creation of a shot 46 vertical from the 
location which specifies the width of street among the space of a travelling direction, The field of 
the head-lining side which covers a part for predetermined distance at least, and meets the 
travelling direction of a route in parallel in this height. And while specifying the field like the wall 
surface of length vertical to a car etc. in the location the field of the side-attachment-wall side 
covering a part for the distance which reaches the location, and also ahead of [ for 
predetermined distance ] each field Image display is carried out to each field concerned by CG 
which encloses the square frame for two or more predetermined actual dimensions of every 
shown in drawing 9 by the grid-like line. Moreover, while enabling it to set spacing of a grit size 
(size on the actual dimension of each grid-like rectangular^head ****) as arbitration The shot 46 
of the three dimension by CG which covers a part for predetermined distance toward one certain 
imagination point ahead of a car, and is converged on each above-mentioned field in parallel is 
generated, and it is made to carry out a synthetic output on a situation image. With the data 
about the grit size after setting out, on an image, if a shot 46 is visual The magnitude of the 
distance between a certain points, area, the volume, an object, etc. is visually measurable, and if 
[ non-vision-], they are measured and it enables it to have displayed with the automatic 
calculation means. 

[0041] In addition, in the principle, about the relation between the camera location loaded into 
the car. a route side, and its incidental object, such shot 46 display can expand the scale, and 
can transpose it to the relation between the camera loaded into the aircraft, a ground side, and 
the spacial configuration object on it, and it be needless to say that it be applicable to all, such 
as a route, a river, a sea route, a depths of the earth way. an orbit, and an air route. 
[0042] next, an image information retrieval system [ in / for explaining some of concrete 
procedures of image retrieval, attribute retrieval, and other retrieval / the gestalt of this 
operation ], if it is CG imaging of the field angle information on a camera location and a camera 
which is the view about the situation image which photoed continuously the situation of the 
perimeter when running actually in the various paths which are objects is carried out. The 
following processings are performed on the assumption that it has the identifier set that the 
information which can reproduce the image is recorded on the image database section 3. and the 
object in CG image can display the attribute and data immediately to a meaning. 
[0043] For example, in searching in relation to the positional information based on LONG and the 
LAT. a kilo label, etc.. it is based on the following procedures. 

(1) Click an object from the real-time dynamic image or the recorded dynamic image (both 
contain a still picture) of the path concerned in the situation graphic display region 31 displayed 
on the display 1 5. the map region 32, and CG image region 33. 

(2) Acquire the location of a camera, a field angle, etc. from the frame of the image with which 
the object was clicked. 

(3) Generate the image of the same location as the frame used for selection of an object from 
the image database section 3, and a field angle. 

(4) Search the object of the location in CG image from the positional information on the selected 
viewports 31 and 32 and the screen where it was clicked in 33. 

(5) Acquire the identifier of the object acquired by retrieval. 

(6) Display an attribute, data, etc. which are in agreement with an identifier on the retrieval result 
viewport 34. 

[0044] Moreover, in searching the attribute of an object, it is based on the following procedures 
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(refer to drawing 7 ). 

(1 ) Click an object from the real-time dynamic image or the recorded dynamic image (both 
contain a still picture) of the path concerned in the situation graphic display region 31 displayed 
on the display 15, the map region 32. and CG image region 33. 

(2) Acquire the identifier of the object acquired by retrieval. 

(3) Display an attribute, data. etc. which are in agreement with an identifier on the retrieval result 
viewport 34. 

[0045] Moreover, in indicating by modification and searching an object by the free view, it is 
based on the following procedures (refer to drawing 4 ). 

(1) Display the situation image in the image database section 3, and generate and display 
simultaneously CG image in the image database section 3 which carried out CG imaging with the 
same point and the same field angle using the camera location and field angle information of a 
frame on the situation image. 

(2) Indicate by the marker with the icon directions in view modification control area 33A into CG 
[ positional information / which was acquired from the situation image / location / of a situation 
image ] image in CG image region 33. 

(3) To compensate for playback of the situation image in the situation graphic display region 31 . 
CG image also repeats generation from a point and field angle information. 

(4) By choosing the function of a free view, it moves freely in the inside of CG image displayed in 
CG image region 33. and can move with a free view in the inside of CG image, and CG image into 
which the view was changed is generated simultaneously. 

(5) Click the object of ** in CG image generated by the migration in CG image. 

(6) Acquire the identifier of the object acquired by retrieval. 

(7) Display an attribute, data. etc. which are in agreement with an identifier on the retrieval result 
viewport 34, 

[0046] Moreover, in calculating and displaying the distance of the object in the point currently 
displayed within the situation image, area, and the volume, it is based on the following procedures 
(refer to drawing 5 ). 

(1) Display the real-time dynamic image or the recorded dynamic image (both contain a still 
picture) of the path concerned on the situation graphic display region 31. and carry out the need 
time click of the object of a point and others after choosing the function of the distance, the 
area, and the volume in the measurement directions region 39. 

(2) Acquire the location of the camera which is a view, a field angle, etc. from the frame of the 
image with which the object was clicked 

(3) CG database section 7 generates the image of the same location as the frame used for the 
target assignment, and a field angle. 

(4) Specify the object of the location in CG image by the positional information on the screen 
where it was clicked in the selected frame. In the case of distance, it is made into two specified 
points, one point of the field in CG image with an intersection, and other one point. In the case of 
area and the volume, it is made into the three-dimension polygon within the field within the three 
dimension constituted by two or more specified points, and a three dimension. 

(5) Calculate and display the distance of the specified object, area, and the volume. 

[0047] Moreover, in calculating and displaying the distance of the object in the point currently 
displayed within CG image, area, and the volume, it is based on the following procedures (refer to 
drawing 6 ). 

(1) Display CG image of the path concerned on CG image region 33. and carry out the need time 
click of the object of a point and others after choosing the function of the distance, the area, 
and the volume in the measurement directions region 39. 

(2) By CG database section 7, generate the image of the same location as the frame used for 
the target assignment, and a field angle, and display the image. 

(3) Specify an object by the positional information on the screen of CG image with which it was 
clicked in the selected frame. In the case of distance, it is made into two specified points, one . 
point of the field in CG image with an intersection, and other one point In the case of area and 
the volume, it is made into the three-dimension polygon within the field within the three 
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dimension constituted by two or more specified points, and a three dimension. 

(4) Calculate and display the distance of the specified object area, and the volume. 

[0048] Moreover, in indicating the view in a situation image by modification, and making it the 

object for retrieval by treating CG image similarly or considering as the entry of retrieval, it is 

based on the following procedures (refer to drawing 4 ). In this case, by specifying a view 

location and a field angle, while accumulating as a texture the image of the space information 

acquired from the continuous image, this texture is recorded on the assumption that an image 

processing is perfonned so that the image seen from that location can be displayed 

(1) Choose modification of a camera location in the real-time dynamic image or the recorded 
dynamic image (both contain a still picture) of the path concerned. 

(2) Calculate the amount of modification for specified modification from an amount, a current 
camera location, and a field angle. 

(3) With the amount of modification, carry out image transformation of the accumulated texture, 
and stick it in an image. 

(4) Repeat and display this. 

[0049] Moreover, in displaying a situation image, CG image, a map. etc. in piles, it is based on the 
following procedures. 

(1) Send a map to a camera location and CG image region 33 which displays CG image for the 
change information on a field angle similarly in the map region 32 by playback of the real-time 
dynamic image of the path concerned, or the image of the recorded dynamic image (both contain 
a still picture). 

(2) the approach specified from the sent change information based on the change information 
which had CG image specified by CG database section 7 — that is, it has arranged — it is — 
generate in piles and display. 

(3) the approach which had the point concerned of a map database specified in the map region 
32 by the map positional information acquired from the sent change information on the other 
hand — that is. it has arranged — it is — display in piles. 

(4) (1) from — (4) The content is repeated and displayed 

[0050] Moreover, when searching the common object in the image database section 3 and CG 
database section 7, it is based on the following procedures, and when "Finding the convenience 
store which is in less than 50 meters from the next crossing of a its present location", it 
explains per (refer to drawing 8 ). 

(1) Send the content of retrieval inputted with the retrieval specification part 10 to the attribute 
retrieval section 11. For example, the content of retrieval chooses compound attribute retrieval 
or A.I. Artificial Intelligence retrieval by retrieval condition input area 40A. It is supposed that the 
next assignment is clicked The object as the 1 st of assignment "A crossing", the 2nd appointed 
object — a "convenience store" and the 3rd appointed retrieval direction — "travelling direction 
— it remains as it is — " — the 4th appointed attribute range — "50 meters" and the 5th 
appointed object for a display — a "convenience store" and the 6th appointed method of 
presentation — " — all — " — — it carries out. 

(2) Search in the range which had the convenience store tor which corresponds by the attribute 
retrieval section 11 and the object attribute database section 8 specified. 

(3) Display the map which is [ result / retrieval ] a perimeter of a point about CG image in 
delivery and the situation image in the point concerned on the map region 32 in the situation 
graphic display region 31 at CG image region 33. and display the attribute data on the display 
control section 14 at the retrieval result viewport 34. 

[0051] 

[Effect of the Invention] This invention is constituted as mentioned above and this the three- 
dimensions information which situation images, such as a dynamic image, a continuation static 
image, etc. of a actual situation [ in / for accumulating / the various paths of a route and a river, 
and others ], have It can relate with the positional information in area maps, such as a map and 
aerial photograph. By building the database of the various objects which carry out CG imaging, 
reconfigurate and are included in a situation image according the various objects by which a 
recognition extract is carried out in three-dimensions information to CG components in that 
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case It not only displays the object for retrieval on a map. but it can enable retrieval and a 
display at the data of for example, the name and attribute in the object in three-dimensions 
information, and the combination and others of them. 

[0052] and of the same kind [ using a situation image as a retrieval signal ] again — it is — it is 

— since the image in which the same object is reflected can be searched from a database and 
the situation image which compares and moreover corresponds to the former can be searched 
easily, all images can be automatically updated easily in the condition of having doubled with the 
position coordinate. 

[0053] It is not only on it but on route management and the field of the part of the shade within 
the inconvenient situation image can be displayed with the same brightness and the same color 
temperature as a perimeter. Can use for acquisition of exact management information, and still 
more nearly similarly, are on route management and mobiles, such as an inconvenient car, are 
deleted from a situation image. A route side without a car can be displayed by acquiring 
information and sticking the null part from other images, and the primitive information in respect 
of route management can be acquired. 

[0054] Moreover, by having compared the dynamic image or the continuation static image with 
the former, and having extended to the three dimension from two-dimensional, measurement 
becomes free, and the three-dimensions measurement of it over two or more frames within the 
situation image of the same frame which continue further is attained, and it enables retrieval by 
the combination of the retrieval conditions covering a variety. And by using effectively combining 
a map technique, CG imaging technology, etc., a search method is extended substantially, it is 
combination, such as a name and an attribute, and retrieval of complicated conditions is possible. 

[0055] Furthermore, the advantage which can correct a shake, revolution, etc. of the image at 
the time of photography on being based on CG image is also acquired. 

[0056] Since the situation image on actual of the perimeter in the point it is running actually, and 
CG image can be display on the other hand when considering as the car^navigation system carry 
in a car etc.. comparison with the actual sight which is not acquire according to the perimeter 
situation under transit i.e.. a map, is make easy, for example, a direction etc. is not mistake by 
the crossing and others in complication and the complicated city section. 

[0057] Moreover, so that the object and attribute data within a situation image may be indicated 
by retrieval through a telecommunication circuit or Web For example, the image database section 
3, CG creation sections 4 and 5, CG database section 7, location bubble ******** 9, the object 
attribute database section 8. the retrieval specification part 1 0. and some displays [ at least ] 1 5 
are carrying out a connection configuration through a telecommunication circuit or Web. the 
newest data of various information — serially — an updating activity — between remote places 

— different ** — it not only being made to provide immediately by moreover making it update 
serially simply but it can also perform-like smoothly and a user can obtain the newest data. 
[0058] Furthermore, a user is available serially considering the various information relevant to 
the path which changes at every day as the newest thing by a situation image, attribute data, 
map data, index information, and enabling it to offer thru/or acquire the work information for 
situation image creation etc. through a telecommunication circuit further, and these being 
updated 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2,**** shows the word which can not be translated 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the gestalt of operation of this invention. 
[Drawing 2] It is chart drawing which similarly explains a shading complement treatment process. 
[Drawing 3] Similarly it is the front view of the example of screen arrangement in a display. 
[Drawing 4] While displaying the data of an object similarly, it is the example of a screen as which 
the modification directions region of a free view was displayed. 

[Drawing 5] It is an example of a screen in the case of similarly measuring the target volume, 
distance, area. etc. by assignment in the area within situation graphic display. 
[Drawing 6] It is an example Fig. of a screen in the case of similarly measuring the target volume, 
distance, area, etc. by assignment in the area within CG image. 

[Drawing 7] It is the example of a screen which displayed the attribute, a location, data, etc. with 
the same object CG image within the area. 

[Drawing 8] It is an example of a screen at the time of similarly searching and displaying an 
object database on the staff. 

[Drawing 9] It is an example of a screen at the time of displaying a shot on the image and image 
similarly displayed in the display area in piles. 
[Description of Notations] 

I — Real-time image acquisition section 2 — Record image data acquisition section 
3 — Image database section 4 — CG manual creation section 

5 — CG automatic creation section 6 — A map and the aerial photograph database section 
7 — CG database section 8 — Object attribute database section 
9 — Location bubble 5Mc****** 1 0 — Retrieval specification part 

II — Attribute retrieval section 12 — Retrieval image input section 
13 — Image retrieval section 14 — Display control section 

15 — Indicating equipment 16 — Updating image data division 
17 — Image complement section 18 — Mobile extract section 
21 — Image image input 22 — Shading extract 

23 — Texture analysis preservation 24 — Criteria color temperature extract 
25 — Perimeter color temperature extract 26 — 3D shading complement 
27 — Frame selection with amendment information 28 — Image cutoff 
29 — Image attachment complement 30A — Amendment video output 
30B — Amendment video output 

31 — Situation graphic display region 32 — Map region 

33 — CG image region 33A — View modification control area 

34 — Retrieval result viewport 35 — Index information retrieval region 
36 — Actuation region 37 — Display-control region 

38 — Call region 39 — Measurement directions region 

40 — Printing directions region 40A — Retrieval condition input area 

41 — Retrieval terminal 42 — Display terminal 

43 — Data sender receiver terminal 45 — Server side data transceiver section 
46 — Shot 
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[Drawing 6] 
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[Drawing 9] 
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